Linear dimension reduction for evolutionary data
نویسندگان
چکیده
We consider the problem of linear dimensionality reduction for high-dimensional evolutionary data, whose distribution changes over time or with respect to a parameter. Supervised dimensionality reduction methods have proven to be very successful in real-world classification problems. When dealing with evolutionary data, we would like to perform classification that is not only robust to noise and short-term changes, but also adaptive to long-term drifts in the data distribution. In order to capture this notion of temporal smoothness, we propose the use of an additional penalty term in classic optimization-based formulations of dimensionality reduction. The penalty term prevents the reduced space in one time step to differ too much from the one in the previous time step. Experiments with synthetic and real-world data provide evidence that such an approach leads to improved classification performance.
منابع مشابه
High Dimensional Data Clustering through Efficient Evolutionary Algorithm
Dimensionality reduction is essential in multidimensional data mining since the dimensionality of real time data could easily extend to higher dimensions. Most recent efforts on dimensionality reduction, however, are not adequate for multidimensional data due to lack of scalability. In this paper, we use the evolutionary algorithm for the dimension reduction process. Initially, our proposed evo...
متن کاملExploratory Data Analysis with Interactive Evolution
We illustrate with two simple examples how Interactive Evolutionary Computation (IEC) can be applied to Exploratory Data Analysis (EDA). IEC is particularly valuable in an EDA context because the objective function is by definition either unknown a priori or difficult to formalize. The first example involves what is probably the simplest possible transformation of data: linear projections. Whil...
متن کاملUniversality laws for randomized dimension reduction, with applications
Dimension reduction is the process of embedding high-dimensional data into a lower dimensional space to facilitate its analysis. In the Euclidean setting, one fundamental technique for dimension reduction is to apply a random linear map to the data. This dimension reduction procedure succeeds when it preserves certain geometric features of the set. The question is how large the embedding dimens...
متن کاملA Multi Linear Discriminant Analysis Method Using a Subtraction Criteria
Linear dimension reduction has been used in different application such as image processing and pattern recognition. All these data folds the original data to vectors and project them to an small dimensions. But in some applications such we may face with data that are not vectors such as image data. Folding the multidimensional data to vectors causes curse of dimensionality and mixed the differe...
متن کاملSubset selection in dimension reduction methods
Dimension reduction methods play an important role in multivariate statistical analysis, in particular with high-dimensional data. Linear methods can be seen as a linear mapping from the original feature space to a dimension reduction subspace. The aim is to transform the data so that the essential structure is more easily understood. However, highly correlated variables provide redundant infor...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010